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ABSTRACT 


There  are  several  diseases  which  can  be  characterized  by  the 
patient  being  in  one  of  a  finite  number  of  states;  e.g.  relapse,  remissive, 
toxic,  etc.  These  states  may  be  both  transient  and  absorbing.  Other 
authors  have  proposed  similar  models  to  describe  data  dealing  with  time 
dependent  phenomena  which  have  assumed  that  the  distribution  spent 
within  any  state  is  exponential.  These  models  are  all  Markovian.  In 
this  paper  we  de^mlop  non-Markovian  models  which  allow  arbitrary 
distributions  within  a  state.  The  model  is  applied  to  clinical  trials 
of  patients  with  acute  leukemia  who  are  undergoing  experimental 
therapy.  The  agreement  of  the  model  and  the  data  is  very  good. 
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1»  Introduction 

There  are  several  diseases  in  edtich  possibly  recurrent  leases  may 

e 

be  distinguished.  Different  investigators  have  proposed  Markovian  models 
to  describe  data  dealing  with  the  time  dependent  phenomena  associated  with 
these  diseases.  We  mention  in  particular  the  woric  of  Fix  and  Neyman  on 
cancer,  [1] ,  the  work  of  Marshall  and  of  Goldhamer  on.  the  epidemiology 
of  mental  disease,  [  2],  and  the  work  of  Ailing  on  tuberculosis,  [3].  All 
of  these  assume  that  the  distribution  of  time  spent  in  an  occurrence  of  a 
particular  phase  is  negative  exponential.  In  the  following  paper  we  present 
a  semi-Maikov  model  for  data  analysis,  in  %vhich  it  is  possible  to  consider 
any  distribution  for  stay  in  a  given  idiase.  The  the<»y  has  been  applied  to 
data  on  victims  of  both  sxsute  myelocitic  and  acute  lymidiocytlc  leukMtia 
vdu>  have  received  experimental  drug  therapy.  In  our  aj^licttion  we  have 
found  that  gamma  distributions  give  a  convenient  representation  td  the 
relevant  probability  densities.  Hence  any  Markov  theory  will  not  be 
sufficient  for  the  study  ot  the  stmisUos  relating  to  leukeaiia.  Wb  feel 
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that  tha  sami-Maricov  model  presented  here  has  wide  applicability  to 
many  clinical  situations. 

The  advantage  of  having  a  model  is  that  it  guides  the  invesUgator 
in  the  type  and  kinds  of  data  to  collect.  Further  a  model  serves  as  a 
convenient  frame  of  reference  for  posing  questions  and  suggesting  further 
experiments.  Too  often  the  "effectiveness"  of  a  treatment  is  measured 
by  the  "  success -ratio"  .  It  is  clear  that  other  factors  are  also  important; 
e. g.  (using  the  terminology  of  the  acute  leukemia  study),  time  in  a  remissive 
state,  time  to  reach  a  remissive  state,  degree  of  toxicity,  time  to  failure  (if 
ailment  is  a  fatal  one),  time  to  complete  cure,  etc. 

2.  Formulation  df  the  Model 

The  health  of  a  patient  can  be  chartoterized  at  any  instant  of  time  by 
being  in  one  a  finite  number  states.  In  the  clinical  terminology,  the 
patient  may  be  in  a  relapse  state,  a  remissive  state,  toxic  sme,etc.  These 
remissive  and  relapse  states  may  be  further  classified  by  the  degree  ^ 
remisslcm  ot  relapse  and  also  by  how  many  and  kinds  of  relapse  cx  rmlsslons 
precectod  the  i»resent  state.  In  addition  to  these  tramsient  states,  the  pattont 
may  have  entered  a  terminal  (ex  absorbing,  in  tto  latHiuage  c/L  Maricov  laocesses) 
state  such  as  failure,  failure  from  othfff  causes,  cure,  or  patient  tost. 

We  shall  let  T  denote  the  set  transient  states  arto  A  the  set 
^  absmbing  states.  Also  we  deftoe 
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U^(t)  B  probability  of  being  in  state  1  at  time  t  ; 

q^(t)  =  probability  density  function  for  a  single  time 

in  state  i  f  T  ; 

00 

Q  (t)  =  /  q.(x)dx 

t 

u^(t)dt  =  probability  of  leaving  state  i  (1  c  T)  during  the 
time  Interval  (t,  t  -t-  dt)  ; 

p^^  B  probability  of  passing  from  state  i  to  J ,  conditional 
upon  leaving  i  ( by  convention  we  set  p^^  s  0  for 
i  €  T). 


It  will  be  convenient  to  define  the  vector  and  matrix  analogues  of 
the  above  quantities.  For  this  purpose  we  let 

Jij(t)  =  column  vector  of  U^it)  ,  i  €  T 

=  column  vector  of  Uj(t)  ,  le  A 

^t)  “  is  the  Kronecker  delta 

ait)  =  (SyQilt)) 

^t)  =  column  vector  of  Uj(t)  ;  =(Uj(0)6y),  Ic  T. 


A 


A  T 

L  o 

&  I 


T 
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As  a  further  convention  we  derujte  the  Laplace  transform  of  any 
time  dependent  function  by  the  same  function  with  argument  s  and  an 
asterisk;  i.e.  w*{8)  =  /{w^{t)}dt,  ;ij)*<s)  =  /  {Ai(t)}  dt  . 

Using  familiar  arguments  in  the  theory  of  semi-Markov  processes  [4], 
one  can  obtain  the  following  equations  for  (s)  and  s)  : 


^*(s)  =  A*(s)Ji°  +  ji*(s)X'<tt'(s)  (1) 

j4  ( s)  =  8)  Ji®  +  a*  ( s)I‘4o*  ( s)  (2) 

which  yield  the  solutions 

=  U- (3) 

Jl*(s)  =  a*(8)U-I'A(8)]"^Hf  •  (4) 

# 


Let  denote  the  probability  of  being  in  an  absorbing  state  at  time  t . 

Then  we  have 

U*(8)=i-i;  U*(s)  (5) 

i  c  T 

from  vdrich  the  moments  of  the  time  to  reach  abscHrptlon  can  easily  be  calculated 
by  noting  that  the  Laplace  transform  ai  the  survivorship  function;  i.  e* 

G(t)  B  pr.  {failure  time  >  t  }l8 
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g*(8)  =  z  U^»)  *4,‘Il!(8)  (6) 

l€  T 

where  X  ^8'  a  column  vector,  of  appropriate  dimension  having  all  elements 
unity. . 

For  the  purpose  of  writing  the  moments  associated  with  G<t)  , 

define 

mj(k)  =  /  t’'qj(t)dt  ,  M(k)  = 

X=  lim  «*(8)  . 

s-*0+ 


Note  that  is  the  expected  number  of  times  state  i  is  visited. 
Then  the  mean  and  variance  of  the  time  to  reach  absorption  are 


E{t)  =  lim  G*(s)  =  (7) 

S'»0+ 


B-lim 

s-*0+ 


where 


M(2)  - 


<8) 


(9) 
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Relatively  simple  recursive  relations  can  be  derived  for  the  higher  moments. 

In  addition  to  the  results  given  so  far,  it  is  possible  to  develop  a 
theory  in  which  the  p.  d.  f.  q^(t)  is  replaced  by  i  i*e. ,  in  which 

the  time  spent  in  any  state  depends  either  on  the  succeeding  or  the  following 
state.  However,  the  results  do  not  have  the  simplicity  of  those  of  Equations 
(7)  and  (8).  They  will  appear  in  a  forthcoming  publication.  Another 
statistic  of  some  interest  in  drug  evaluation  is  the  total  time  spent  in  a 
given  transient  state.  This  is  important  in  the  leukemia  study;  since  it 
is  desirable  to  prolong  a  patient's  life  in  a  condition  of  remission  rather 
than  in  a  condition  of  active  illness.  Let  us  consider  a  single  remissive 
state  i  and  partitlpn  the  transition  matrix  ^  as 


A  i  T-i 

*  **1 

X  ft  a  A 

.  (10) 

'  4,  ft  A  1 

X  &  Jl  T-1 

Then  the  pn^sbillty  of  entering  state  1  at  least  oiwe  starting  frcxn  state  J  is 


i>,i*[u-£r*Aij  1*1 
hu-AJlU-A)'*;!  • 


(U) 


The  first  two  moments  the  total  sojmim  time  in  state  1  conditiimal  <»i 
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staiting  from  stato  J  are 

\ 


V  (12) 


/ 

3.  Applications  to  Acute  Leukemia  Clinical  Data 

A  large  number  of  clinical  trials  were  conducted  by  the  Acute  Leukemia 
Qcoxip  B  (Frei  et  al.  [  5] )  on  patients  having  acute  leukemia.  In  this  section 
we  will  illustrate  the  application  of  our  model  to  a  portion  oi  these  data.  A 
more  complete  discussion  of  the  data  will  be  given  in  another  publication. 

All  patients  entered  these  clinical  trials  while  in  a  state  ot  relapse. 

The  data  examined  in  this  paper  were  for  patients  vdio  were  initially  given 
Methotrexate  ( MIX) .  The  patients  eitlmr  never  responded  and  ea^red,  or 
eventually  reached  a  remissive  state.  A  distimstlon  was  made  between  a 
partial  and  complete  remission.  If  the  patients  did  not  show  rmnissimi 
within  the  first  6  weeks,  the  MIX  therapy  was  sto^EWd,  a  pKtod  two 
weeks  was  allowed  to  elapse,  at  the  oonclusim  oi  vdiioh  the  siuviving 
patients  who  were  stUl  in  a  stM  oi  rplapse  w«e  givKi  6-aMroaiitopui^ 

( 6-MP).  Further,  if  a  patient  vdio  vms  in  remissicm  mttered  a  rtfUqpeed 
state,  the  tlmapy  was  chmiged  to  tiie  alhuMte  drug  mr 


m,(l)  m(l)h. 

rniJJ’  ®ij  1  -  hjj 


m,(2)  2m“(l)h.. 


u  <*-V 


In  thl0  paper  we  will  apply  the  model  to  date  from  26  patients  who  achieved 
a  state  of  remission  within  8  weeks  of  entering  these  clhiical  trials.  In  our 
application  we  will  be  mainly  interested  in  the  distribution  of  the  time  to 
failvure.  Since,  by  definition,  a  remissive  state  is  always  followed  by  a 
relapse  state  we  will  combine  the  sojourn  time  in  a  relapse  state  with  the 
sojourn  time  of  the  remissive  state  which  immediately  preceded  it.  AnotlMr 
characteristic  of  this  application  is  that  the  data  indicate  dlffMent  sojourn 
time  distributions  i^ilch  depend  on  the  number  of  times  the  patient  has  been 
in  the  state.  With  these  characteristics  ci  tlm  laxMess  in  mind,  we  d^Une 
the  six  states: 

Sq  :  failure  ( death) 

*  :  initial  relapse  state  ( condition  of  patient  on 

entering  study) 

:  first  partial  remission  ( also  Includes  subsequent 
relapse) 

Sj  t  second  partial  rmnlssion  (includes  sidmequent 
relapse) 

:  f^t  ompuplete  remission  (includes  subseqiMnt 

relapse) 

:  second  crnaplete  rmaission  (includes  subseqiMnS 
relapse) 

The  communicttion  amcmg  stales  may  be  summarised  in  the  ic^wtog  diagsrsm 
tdieie  aU  states  conMct  with  . 
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Figure  1 

State  Diagram  a  Model  of  Leukemia 

An  investigation  of  the  distribution  of  sojourn  times  within  the 
various  transient  states  showed  that  with  the  exception  of  the  Initial 
state,  these  distributions  can  be  well  apjpcoximated  by  gamma  distributions, 
i,o. 

r(t)  =  )ie‘V  (xt)*'^/r(a)  ,  t  >  0  ,  a  >  0  . 

The  parameters  ( a,  X.)  were  estimated  from  the  data  by  the  method  of 
maximum  likelihood  with  the  aid  of  the  convenient  tables  WUk , 
Ghianadeslkan,  and  Huyett  [  6] .  Table  1  summarise!  the  results  td 


these  oalculationsi 


Tabltt  1 


Sampla  Maana,  Varlancat,  and  Maximum  Likelihood  Eatlmatea  ci  the 
Parameters  of  Gamma  Dietribution* 


State 

A 

a 

A 

X 

hill 

-2 

9 

Sample  Size 

$2  (first  P.R.) 

2.3 

0.101 

23.1 

189 

14 

( second  P.  R. ) 

2.9 

.122 

23.6 

.215 

7 

(first  C.R. ) 

4.7 

.132 

35.6 

310 

27 

Sg  ( seccmd  C.  R. ) 

15.5 

.463 

33.6 

90 

7 

K  rraiaina  to  cdstain  estimates  ol  the  transition  ixobabilities  X 
before  the  foimulas  of  the  pnceethng  section  can  be  applied.  The  deserved 
relative  frequencies  (conditional  cm  goiixi  to  a  r«nlssion  state)  daserved  in 
these  clinical  trials  were  used  as  estimates  of  the  (P^j)  •  The  nuaMtical 
results  aret 


So 

e 

S2 

S4 

S5 

e 

So 

1 

0 

0 

6 

0 

0 

0 

0 

10/26  0 

16/26 

0 

S2 

Z  « 

5/10 

b 

0 

3/10 

0 

2/10 

®3« 

1 

0  . 

0 

0 

0 

0 

*4 

9/16 

0 

0 

4/16 

0 

3/16 

h 

1 

0 

0 

0 

0 

0 

«n 

fhaee  esttsMi^  ace  buMd  on  att  paitoati  wm  li<»;»faijitff,t|6ifi  Mwti: 

i^R.  ■ 
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Tlw  estimate  of  the  transition  matrix  X  parameters  df  the  gamma 

distribution  summarize  the  relevant  information  with  the  exception  of  the 

sojourn  time  distribution  for  the  Initial  relapse  state  ( S^) .  Here  the 

distribution  is  complicated  by  being  truncated  at  the  end  of  eight  weeks. 

Since  the  data  are  summarized  in  units  of  a  week,  this  distribution 

(conditional  on  a  patient  reaching  a  remissive  state)  was  assumed 

to  be  a  discrete  distribution  whore  p  denotes  the  probability  of 

n 

entering  a  remissive  state  after  n  weeks  in  the  initial  relapse  state. 

The  observed  relative  frequencies  were  taken  as  the  estimates  for  p 


and  were: 

n  =  2 

3 

4 

5  6 

T_ 

“ 

p^  =  [2/26 

6/26 

8/26 

5/26  4/26 

1/26  ] 

A  check  on  the  model  can  be  obtained  by  comparing  the  sample 
mean  and  variance  of  the  time  to  reach  failure  with  the  thecnretlcal  fcmnulas 
given  in  (7)  and  (8).  The  numerical  results  are: 


Data 

Model 

Mean 

48.4 

49.7 

Variance 

515. 

525. 

We  now  turn  our  attention  to  estimating  the  distrU>ution  of  the  time 
to  reach  the  failure  state.  The  i»obability  density  function  for  those  pMiaitts 
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reaching  a  remissive  state  can  be  calculated  using  (6).  After  some 
reduction,  the  result  is: 

“  **20*’l2^^1  *  ^2^  P30^*’l2‘’23*^l  *  ^2  *  ^3^  ■*■  **14*’43^^1  *  ^3*  ^4^^ 

■*■  *’40**14^^1*^4^  **50^  **12*’25*  ^1  *  ^2  *  ^5^  *’l4*’45^^1  *  ^4  *  ^5^^ 

(The  notation  denotes  the  convolution  of  ^^(t)  and  where 

f^(t)  denotes  the  frequency  function  of  the  initial  relapse  state. ) 

Note  that  g^Ct)  is  made  up  of  a  mixture  of  distributions  vdUch  involve 

convolutions  of  gamma  distributions.  For  our  purposes,  the  approximation  of 

convolutions  of  gamma  distributions  by  a  gamma  distribution  with  the  same 

first  two  moments  was  deemed  a  sufficient  api»oximatlon .  Figure  2  contains 
t 

a  plot  of  G.(t)  =  f  g  (x)dx  along  with  the  sample  data.  The  agreement 
0 

is  remadcable. 

We  would  like  to  thardc  Dr.  Edmund  Gehan  of  the  National  Institutes 
of  Health  for  helpful  discussions  of  this  problem  and  his  cooperation  in 
providing  us  with  records  of  the  leukemia  study 
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